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Some Dimensions of Interpersonal Relations in 
Three-Man Airplane Crews 


BENJAMIN FRUCHTER, ROBERT R. BLAKE, AND JANE SRYGLEY MOUTON 
University of Texas* 


CONSTRUCTION OF THE CREW INTERACTION 
SCALES 
Introduction 


NE of the interesting characteristics 
O of a number of modern technologi- 
cal devices and systems is that their 
operation requires the team work of 
several people. This consideration leads 
to questions concerning the extent to 
which the interpersonal relations, which 
are part of the basis of organizational 
efficiency, can be measured and predicted. 

The purposes of this study were: (a) to 
construct a scale for assessing the inter- 
personal relations of three-man, B-47, 
medium-bomber crews consisting of air- 
craft commander (AC), observer (O), and 
copilot (P); (b) to determine the basic 
content or factors represented in the 
items; and (c) to estimate the reliability 
and validity of the resulting homogene- 
ous scales. 


Rationale for Selecting Items 


Several conceptual approaches to 
group phenomena were considered in 
selecting items to be included in the 
initial form of the instrument. 


Theory and experiments in the field of group 
dynamics (5) which have led to the development 
of concepts such as “group standard” and “group 


‘This research was supported in part by the 
USAF under Contract Number AF 18(600)-602, 
monitored by the 3305th Research and Develop- 
ment Group (Combat Crew Training Research 
Laboratory), Human Resources Research Center, 
Randolph Air Force Base, Texas, 


cohesiveness” were reviewed, and items suitable 
for measuring these dimensions in B-47 crews 
were developed. The approach by Homans (3)— 
which relates the group work system to its social 
system through variables such as liking and 
amount of interaction—also was examined, with 
items being written to measure these aspects of 
group behavior. Recent developments in group 
therapy (7) that emphasize group and individual 
relations between members and the leader, and 
also among members, both from a choice and per- 
ceptual standpoint, and that have resulted in 
experiments on the accuracy of interpersonal per- 
ceptions in small groups were examined; and 
items suggested by developments in this area also 
were included. Scales that had been developed 
for measuring the relationships among B-29 crew 
members were examined; some items from such 
scales were included because of their demon- 
strated value in measuring interpersonal rela- 
tions. Finally, the sociometric literature was sur- 
veyed for additional items that had been found 
useful for evaluating interpersonal relations in a 
variety of work situations. 

Items from each source were adapted for meas- 
uring relations among B-17 crew members. A 
final scale was developed after a tentative scale 
had been devised and evaluated through inter- 
views with B-47 crew members and all items had 
been found acceptable in the sense that they as- 
sess relationships that crew members considered to 
be relevant in evaluating their crew performance. 
On the basis of nontechnical considerations con- 
cerning unsuitability of items for use in measur- 
ing crew relations, pointed out by flying and op- 
erational personnel, many items which otherwise 
appeared useful for scaling interpersonal rela- 
tionships were deleted. 


Description of the Crew Interaction Scale 


The Crew Interaction Scale consisted 
of 44 items concerning a variety of as- 
pects of crew relations. 

The first 22 items required each crew member 


to rank himself and each of the other two 
members on some aspect of each member's crew 
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performance. Items included the extent to which 
each dominates the decision making of the crew, 
accepts responsibility for both air and ground 
activities, is agreeable and willing to go along 
with crew decisions, and exhibits self-control 
during periods of stress in the air, 

The next five items dealt with how each crew 
member relates to the others. They included 
items such as the extent to which each crew 
member sees himself as clashing with the others, 
the degree to which each member feels he can 
influence the others to change decisions, and 
how much each feels a handicap in doing his 
job because of not obtaining necessary informa- 
tion and instructions from other members, 

The final 17 items called for evaluation by 
its members of the crew as a whole, Items such 
as the degree to which the crew functions on the 
basis of an informal code of procedure and the 
extent to which members see the crew as a well 
organized team were included in this section. 


The Ranking-Rating Technique 


In a preliminary laboratory investiga- 
tion with three-man groups, rankings 
had been found to be satisfactorily con- 
sistent from group to group (1). In addi- 
tion to using the ranking method, it was 
also considered desirable to devise a rat- 


ing scale for determining the relative 
strength of each ranking. The crew mem- 
bers were given the following directions: 


In filling out the following items think of 
the three members of your crew—yourself and 
the two others—and try to characterize how each 
behaves in terms of the scale provided. Use the 
symbol AC for Aircraft Commander, P for Pilot, 
and O for Observer to identify yourself and the 
other two crew members. Make an effort to put 
the identification symbol of only one crew mem- 
ber in any one box. 


Depending on the characteristics 
judged, two types of scales were used. 
One is a bipolar scale with a neutral 
point in the middle, and the other is an 
all-to-none scale with a 50-per-cent point 
at the center. In constructing a scale, 
the intervals were kept as uniform as 
possible by using the same or similar 
modifying phrases to define positions 
along the continuum. The following is 
an example of the type of scale used to 


measure bipolar characteristics: 


Rank the members of your crew for the 
extent to which they accept or reject responsibil- 
ity in both air and ground activities. 


L] 
very often 


always rejects extremely often 
responsibility 


neither accepts 


often 
nor rejects re- 
sponsibility 


extremely often 


often accepts 
responsibility 


ay 


always accepts 
responsibility 


very often 


An example of a scale used to measure 
characteristics that can be scaled along 
an all-to-none continuum is: 

Rank the members of your crew for the fre- 


quency with which they make errors in the per- 
formance of crew activities in the air. 


CL) 


always makes extremely often very often 


errors 


often makes errors a little 
some of the time 


a 
never makes 


very little almost never 
errors 


According to the instructions for both 
kinds of scales, each crew member placed 
his rankings of the three crew members 
(including himself) at the appropriate 
positions on the nine-point continuum. 
Tied ratings were not allowed. Some 
crew members objected to being forced 
occasionally to make a discrimination, as 
was required by the “no ties” restric- 
tion. The objection was met by allowing 
the rater to place more than one person 
within a scale interval and indicating the 
rank-ordering within the interval. 


Items Included in the Scale 


The following are the 44 items on 
which each crew member rated himself 
and the other two members of his crew. 


CJ 
C] 


INTERPERSONAL RELATIONS IN 


1. Rank the members of your crew for the 
extent to which they accept or reject responsibil- 
ity in both air and ground activities. 

2. Rank the members of your crew in terms 
of being agreeable and willing to go along with 
crew decisions in both air and ground activities. 

3. Rank the members of your crew in terms of 
the extent they take the initiative in getting 
'- things done in both air and ground activities. 

4. Rank the members of your crew for the 
frequency with which they make errors in the 
performance of crew activities in the air. 

5. Rank the members of your crew for the 
extent to which they work cooperatively with 
the crew in both air and ground activities. 

6. Rank the members of your crew in terms 
of the amount of leadership they provide during 
air activities. 

7. Rank the members of your crew for the 
extent to which they keep the crew “on the 
ball” in both air and ground activities. 

8. Rank the members of your crew for the 
extent to which their actions are well-timed and 
appropriate to the actions of the other members 
of the crew in air activities. 

g. Rank the members of your crew for the 
extent to which they place crew welfare above 
personal considerations in both air and ground 
activities. 

10. To what extent do the members of your 
crew follow the directions and suggestions of 
the others in critical air situations? 

11. Rank the members of your crew for the 
extent to which they put your crew at ease and 
make being a member of the crew more enjoy- 
able in both air and ground activities. 

12. Rank the members of your crew for the 
extent to which they feel frustrated by being 
a member of this crew. 

13. To what extent do the members of your 
crew usually agree about what should be done 
in the air? 

14. Rank the members of your crew for their 
competence, in air activities, in the specialty to 
which they are assigned. 

15. Rank the members of your crew in terms 
of the extent to which they want to do a good 
job in both air and ground activities. 

16. Rank the members of your crew for self- 
control during periods of stress in the air. 

17. Rank the members of your crew for clarity 
in giving directions both in air and ground 
activities. 

18. Rank the members of your crew for their 
satisfaction with the crew’s over-all performance 
in both air and ground activities. 

19. Rank the members of your crew for the 
extent to which they dominate the decision 
making of the crew in both air and ground 
activities. 
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20. Rank the members of your crew in terms 
of the extent to which they keep reminding the 
crew of regulations and SOP in both air and 
ground activities. 

21. Rank the members of your crew in terms 
of the extent to which they are interested in 
their technical specialty in both air and ground 
activities, 

22. Rank the members of your crew for the 
extent to which they are consistent (level of per- 
formance same from day to day) in their per- 
formance of activities in the air. 

23. Rank the other members of your crew 
in terms of the degree you clash with.them in 


crew discussions both in the air and on the 


ground. 

24. Rank the two other members of your 
crew in terms of your liking for them in both 
air and ground relationships. 

25. Rank the other two members of your 
crew in terms of the ease with which you can 
influence them to change their decisions in both 
air and ground activities. 

26. Rank the other two members of your 
crew for the readiness with which you would 
expect them to back you up if a misunder- 
standing arose in your crew in ground activities. 

27. Rank the other two crew members in 
terms of how often you are handicapped in 
doing your job because he has not given you 
necessary information or instructions in both 
ground and air activities. 

28. To what extent does your crew work as a 
well organized team rather than as a collection 
of individuals in both air and ground activities? 

29. To what extent do you feel “left out” of 
important decisions that your crew makes in 
both air and ground activities? 

go. How well satisfied are you with the way 
you, personally, have worked out in this crew 
in its air activities? 

31. What is your attitude toward remaining 
with your present crew? 

gz. Rate your crew for its enthusiasm for 
flying in present crew assignments. 

33. Rate your crew for the speed with which 
it comes to agreement when decisions have to 
be made in the air. 

34. Rate your crew in terms of its willing- 
ness to fly under adverse conditions. 

35. Rate your crew for the extent to which 
it is a well organized team in both air and 
ground activities. 

36. Rate your crew for its confidence in its 
ability to perform in critical situations in the 
air, 

37- Rate the morale of your crew in both air 
and ground activities. 

38. Rate your crew for the extent to which 
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it sticks together in the face of disrupting factors 
in both air and ground activities. 

39. Rate your crew for the extent to which 
it is a “stickler” for following formal or official 
regulations and SOP in both air and ground 
activities. 

40. Rate your crew for its effectiveness in 
planning together in both air and ground activi- 
ties. 

41. Rate your crew for the extent to which it 
is able to maintain a consistent level of flying 
efficiency. 

42. Rate your crew for the frequency with 
which it makes errors in carrying out its air 
assignments. 

43. Rate your crew for its “cockpit confu- 
sion.” 

‘44. Rate your crew for the extent to which it 
functions in terms of an informal code of proce- 
dures that it has worked out by itself in its 
air activities, 


SAMPLE 


The Crew Interaction Scale was ad- 
ministered to go male flying officers, who 
composed go intact B-47 crews in opera- 
tional training. Crews had been organ- 
ized for approximately four to five 
months. All were tested individually for 
an hour. Data collection took place over 
a one-week period since only small num- 
bers of personnel could be made avail- 
able in any one test period. 


ITEM ANALYSIS 


Agreement in Crew Ratings by Items 


Since each member rated either the 
crew as a whole or specifically desig- 
nated members, several ratings of a crew 
and its members were obtained from each 
item. From a statistical point of view the 
means of the several ratings should repre- 
sent a better estimate of the characteristic 
being judged than any of the ratings 
considered separately. To represent use- 
ful estimates it is desirable that inter- 
crew means be differentiated adequately 
relative to the individual ratings on the 
characteristic being judged. Horst (4) 
has developed a procedure which can be 
applied to estimating the extent of agree- 


ment in ratings for any one crew rela- 
tive to the discrimination between crews. 
If ratings are internally consistent, in the 
sense that the several judgments within 
each crew or by each crew member agree 
perfectly, the Horst coefficient would be 
+1.0. As the spread of the ratings around 
the mean of the within-crew ratings in- 
creases, the index approaches zero. Horst 
has demonstrated that the formula is 
related to the Spearman-Brown method 
for estimating reliability and to the 
Kuder-Richardson formula (no. 21) for 
internal consistency. 

Each rating was weighted from zero at 
the “most desirable” end of the scale to 
eight at the “least desirable” end. Agree- 
ment indexes were computed for the fol- 
lowing combined-score ratings. (a) The 
variance of the sum of the ratings of the 
crews on a given item was evaluated 
against the within-crew variance. (b) 
Next, the variance of the sum of the 
ratings of the crews on a given item was 
also evaluated against all the within-crew 
variance exclusive of the self-ratings. (c) 
Finally, the variance of the sum of the 
ratings for a crew position on a given 
item was evaluated against the within- 
crew variance of those ratings. 

The Horst agreement coefficients for 
the scores included in scales are shown 
in Tables 5 through 10. The results for 
all of the items inay be summarized as 
follows: 

The interrater agreement indexes for 
the crew totals on the first 27 items (of 
which, the first 22 were based on nine 
ratings. and the next 5 on six ratings 
each per crew) were satisfactorily high 
with few exceptions. The results indi- 
cated both an acceptable consensus 
among crew members in rating one an- 
other and a satisfactory discrimination 
between crew means. 

There were only three sets of ratings 
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for each crew on the last 17 items. As 
computed by the Horst method, these 
items had a wider range of interrater 
agreement values. Also, from the stand- 
point of the kind of judgments involved, 
items 29, 30, and 31 were different from 
the others, since the respondent was re- 
quired to evaluate his own relationship 
to the crew rather than to rate the crew 
as a unit. Such items might be suitable 
for differentiating among individuals, 
but they would not be suitable for com- 
puting mean crew ratings. Indexes of 
agreement were therefore not obtained 
for these three items. Mean ratings for 
items 39 and 44 did not adequately dis- 
criminate among crews. Both refer to the 
extent to which the crew functions in 
accordance with a prescribed rather than 
an informal group structure. The agree- 
ment values for items 33, 34, and 40, con- 
cerned with speed in reaching crew agree- 
ment, readiness to fly under adverse con- 
ditions, and crew planning effectiveness, 
were also unsatisfactorily low. 

The general conclusions from assessing 
the consistency of crew ratings by the 
Horst method were that crew members 
do agree in their judgments on most 
items and that there is satisfactory dis- 
crimination among the means of differ- 
ent crews. Items were next considered 
from the standpoint of validity. 


Criteria Used for Validation 


Two sets of proficiency rankings were 
procured from supervisory personnel at 
Lake Charles Air Force Base. They were 
a ranking of crews on a wing basis and a 
ranking of crews by squadron, within the 
wing. 


The 67th Wing had been assembled as an 
operational unit four or five months previously. 
The Wing Standardization Board, which was 
composed of skilled personne] representing each 
of the three specialties, had completed the 
evaluation of the crews used in the validation 


study during the week previous to the test ad- 
ministration. In making its evaluations the Wing 
Standardization Board used a fixed set of cri- 
teria, and, on the basis of the evaluation of 
specific components of individual] performance 
and coordination among crew members, assigned 
a ranking for each crew in the wing. 

Crews within each squadron were ranked in 
terms of performance efficiency as judged by 
three squadron commanders, who based their 
rankings on information supplied both by flight 
commanders and the squadron operations officers. 
The two most important considerations in mak- 
ing these ratings were the circular error in navi- 
gation and bombing assignments and the level 
of performance of the Observer. 


Rankings by squadron and wing were 
used to distribute the crews into high, 
middle, and low performance groups to 
be used in validating the Crew Interac- 
tion Scale. The three performance groups 
were determined by combining the stand- 
ings given by the Wing Standardization 
Board with squadron rankings. Each of 
the three sets of rankings was given an 
equal weight and the rankings summed 
into a single score. The 10 crews with 
the highest combined rankings were iden- 
tified as the high group, the next 10 as 
the middle group, and the lowest 10 as 
the low performance group. 


Item Validity 


The validity for each item was deter- 
mined in the following manner. An inte- 
gral score value was located as close as 
possible to the median of the distribu- 
tion for each item. The number of item- 
ratings above and below the median 
score for each of the three criterion 
groups was then determined. The follow- 
ing diagram shows how the data were set 
up for an item: 


Performance 


Low Middle High 
Above 2 5 7 
Below 8 5 3 


(Item 1 AC,) 


Median 
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A chi-square test for the significance 
of the differences between the number 
above and below the median in the 
three criterion groups was made, and 
the contingency correlation coefficient, 
corrected for coarse grouping, was cal- 
culated for those items having significant 
chi squares. 

The results indicated that many items 
are related significantly to the criterion 
groups at, or below, the go-per-cent level 
of confidence. Item validity results will 
be discussed in connection with homo- 
geneous scale validation in a later sec- 
tion, 


CONSTRUCTION OF HOMOGENEOUS KEYS 
Scaling Procedure 


To determine whether the items in the 
Crew Interaction Scale could be classified 
into several independent aspects of crew 
behavior, an analysis of the relationships 
among the items was made to identify 
homogeneous keys. The process was be- 
gun by classifying items into six cate- 
gories, based on the rationale for test 
construction, Items were chosen for in- 
clusion in the first tentative clusters on 
the basis of their agreement indexes, or 
significance levels of validity, or both. 
The following set of symbols was used 
for designating scores: 


a. The subscript ¢ following the item num- 
ber indicates the sum of all ratings made on 
the item (eg. 1, (The number “1” refers, of 
course, to item-number.) 

b. The subscript t following the abbrevia- 
tion for a crew position for items 1 to 27 indi- 
cates the sum of the ratings received by that 
crew position (e.g., 1 AC,). 

c. The subscript s following the abbreviation 
for a crew position for items 1 to 27 indicates 
the self-rating by crew position, 

d. The combination of the abbreviations of 
two crew positions separated by an oblique line 
indicates the rating(s) given by the one crew 
position to the other (e.g., 1 AC/O). 

e. On items 28 to 44 the crew positions’ 
abbreviations following the item number indi- 


cate the ratings given the crew by that crew 
position (e.g., 28 AC). 

There were six tentative clusters iden- 
tified at the beginning of the scaling 
procedure. They were composed of the 
scores listed below. 

Cluster 
. Leadership 
. Cooperation 


1 
2 
3. Interpersonal Relations 
4. Technical Competence 
5 
6 


Scores* 
1,, 3 AC, 
12 AC,, 25 AC, 
4 15 O; 
131, 352, 38% 
21,, 25 P/AC, 40 P 


. Morale 
. Formal Group Structure 


After these preliminary scales had been 
assembled, scaling was done by Stice and 
Knoell’s (6) modification of the Wherry- 
Gaylord (8) procedure for homogeneous 
keying. One advantage of this procedure 
is that it does not require the calcula- 
tion of the item intercorrelations at the 
beginning of the analysis. 


The correlations between the total score for 
each scale and score on each of the 86 items 
considered for inclusion in the scales were 
determined and evaluated. A correction was 
applied to the correlation obtained between the 
item and the scale score to compensate for 
spuriousness due to the inclusion of the item 
in the scale score. Items not in a scale, that had 
higher correlations with a scale than items that 
were included, were then added; and items hav- 
ing a low correlation with the scale were 
dropped. The process was continued in order 
to obtain a stable set of items for each scale. 
Iteration produced stable sets of items for four 
scales. Since the Formal Group Structure scale 
and Interpersonal Relations scale were not 
stable, no further analysis was made of them. 

Approximately 26 item scores were included 
in the scales developed in the manner de- 
scribed above (see Tables 5, 6, 8, and 4g). 
Additional homogeneous keys composed of items 
not already included in the existing scales were 
then derived. Item intercorrelations were esti- 
mated and placed in matrix form, and two addi- 
tional tentative clusters were obtained by in- 
spection, Items were added to clusters and 
clusters were stabilized through the iteration 
process. Two additional scales, identified by the 
titles Crew Unity and Crew Coordination, were 
derived (see Tables 7 and 10), 


*See footnote to Table 1 for an explanation 
of the symbols. 
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TABLE 1 
CoRRELATIONS BETWEEN ITEM SCORES AND TOTAL SCORES ON THE Stix HoMoGENEOUS KEYS 


Homogeneous Keys 


Technical 
Competence 


Crew 


Leadership 


dination Morale Cooperation 


+20 -45 -57 
-O7 -39 .36 
-20 .10 .09 
.00 .16 .20 
-21 -47 -67 
.18 

.28 

-22 -15 

-30 -75 

-61 

.61 

-09 

-20 

-25 

-14 

-44 

-O7 

“44 

47 

-47 

.28 

.28 

.20 

-25 

-39 

-39 

-39 

+33 

“44 

-23 

+04 

-15 

-41 


eee 7 
Unity 
1 AC; -33 
1 AC, .20 
1 O/P -33 
2t 
3 AC, - 
40 .23 
4 AC/O 
St -30 
5 AC 
50 -37 
6 AC/O .00 
6 AC/P — .07 
8 AC 
8 P/AC -17 
8 P, = 36 
9 P/O 
10; 
10 O/P .03 
11 AC, 37 
12¢ 
12 AC; -37 
131 .23 
140 .20 
14 P/O .30 
1S¢ -62 
15 O/P 
16, -50 
16 P 
17 O/P .07 
18; -O7 
18 P/O .20 
20% +33 
4 20 AC, 29 
20 AC, 
21 AC/O 
21 AC/P -23 
22: -40 
22 O, .40 .02 .12 -14 .09 .03 
230 37 —.07 .07 -03 .O1 .07 
23 P/O 18 — .31 — .09 .09 —.15 .00 
24 AC —.11 39 33 27 
24 P/AC — .16 22 12 27 
26% .16 -49 .40 
260 22 .18 .09 -41 .68 
27t +00 +33 +17 -37 64 
28 -24 .07 -55 -30 
20¢ .18 —.31 — .09 — .09 —.15 -00 
3lt .16 .20 -45 -47 
.22 .09 -59 -43 
33 P a -33 
34 AC .16 .00 — .04 .04 «33 
+22 .28 .70 -33 -40 
36 P .18 -31 .20 .23 -33 
37t -36 .40 ~25 -39 -47 
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TABLE 1 (Continued) 


Homogeneous Keys 


Technical 
Competence 


Leadership ¢ 


dination 


Morale Cooperation 


* The following is the set of symbols for designating the scores in this table. 
a. The subscript ¢ following the item number indicates the sum of all ratings made on the item 


(e. 


op 
b. The subscript ¢ following the abbreviation for a crew position for items 1 to 27 indicates the sum 
- of the ratings received by that crew position (e.g., 1 AC,). 
c. The subscript s following the abbreviation for a crew position for items 1 to 27 indicates the self- 


rating by crew position. 


d. The combination of the abbreviations of two crew positions separated by an oblique line indicates 
the rating(s) given by the one crew position to the other (e.g., 1 AC/O). 

e. On items 28 to 44 the crew positions’ abbreviations following the item number indicates the 
ratings given the crew by that crew position (e.g.,28 AC). 


Item-scale correlations were examined and 
further changes were made in scale content by 
eliminating items having high correlations with 
more than one scale. 

These operations resulted in the 
stabilization of scales identified as Tech- 
nical Competence, Leadership, Crew 
Coordination, Morale, Cooperation, and 
Crew Unity. The loadings of the item 
total and part-scores on the six scales 
are shown in Table 1. 

The item content of the scales, load- 
ings, agreement indexes, and validity 
significance levels are given in a later 
section entitled “Interpretation and Dis- 
cussion of Homogeneous Scales.” 


Intercorrelations of Scales 


To determine the degree of interde- 
pendence among the scales, the six scale 
scores for each crew were intercorrelated 
by the product-moment method.* The 
resulting correlations are shown in Table 
2. An inspection of the coefficients indi- 
cates that the Technical Competence 


* The items were scored so that the end of the 
scale that was considered to represent the most 
favorable responses was given a weight of zero, 
and the response at the least favorable end of 
the nine-point scale was given a weight of eight. 
Therefore low scores were considered “good” 
scores. 


TABLE 2 


INTERCORRELATIONS OF THE SCALE Keys (Matrix R,) 
(N=30 B-47 Crews) 


3 


. Technical Competence 
. Leadership 

. Crew Coordination 

. Morale 

. Cooperation 

. Crew Unity 


-62 


8 
Unity 
38 0 — .04 .09 .23 
30 P —.27 -33 +09 .09 .17 .17 
40% -13 -38 +20 -43 -36 
«28 -36 -63 -40 
42: -34 +27 -45 .20 
420 .O7 — .02 .07 -15 -17 
430 —.29 -56 -16 .07 -10 
Key 2 r] 4 5 6 
I .03 -57 -34 +52 
2 |__| .66 .68 -74 
3 -63 -49 -68 
4 -74 -96 
5 +79 
6 
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TABLE 3 


Matrix 
(Inverse of Matrix R,) 


I 2 


3 4 5 


2.4786 
-3978 
1.4564 
— 2.7437 
-2077 


2.4408 
— .§329 
— .8105 
+9336 


-2077 
— .9336 
+3325 
—1.6627 
2.5881 


1.4564 
— -53290 
2.7647 
— 2.4754 
+3325 


— 2.7437 
— .8105 
— 2.4754 
5.8863 
—1.6627 


scale has the lowest correlations with 
the other keys. Crew Unity was omitted 
from further consideration because of its 
high correlation with the Morale key. Of 
the two, the Morale key seemed more 
satisfactory. Scales were positively inter- 
correlated with the exception of a small 
negative coefficient between Technical 
Competence and Crew Coordination. 
As a further test of independence 
among homogeneous scales, the inverse 
of their correlation matrix was computed. 
If the matrix could not be inverted it 
would be an indication that the scales 
were not linearly independent and some 
of the scales would be presumed to be 
combinations of others. The inverse 
(R,-*), as shown in Table 3, gave further 
support to the conclusion that the vari- 
ous scales (except “Crew Unity’) repre- 
sent essentially independent dimensions. 


Scale Reliability 


The reliability for each scale was de- 
termined by correlating odd and even 
item scores, based on the nine-point scale 
values. The Spearman-Brown correction 
for estimating the reliability of the full- 
length scales was also applied, and the 
corrected values are shown in Table 4. 
The reliabilities for the Leadership, 
Crew Coordination, and Cooperation 
keys are somewhat inflated since part 
scores from the same item appeared in 
both the odd and even total scores (e.g., 


two scores derived from Item 1 appear 
on the Leadership key). 

With but one exception the corrected 
odd-even reliability coefficients are satis- 
factorily high for administrative use as 
separate scale measures. The exception 
is the Leadership key which, with a co- 
efficient of .76, is satisfactory as a sub- 
scale within a battery. 


Scale Validity 


In order to assess the validity of the 
derived homogeneous keys, scale scores 
were correlated against the trichotomized 
performance criterion with results as 
shown in Table 4. 

Since the means on the Leadership key 
for the middle and low groups were close 
together and since they both differed 
considerably from the mean for the high 
group, a biserial validity coefficient was 
also computed. The distributions for the 
two lower groups were combined and 
the resulting distribution contrasted with 
the distribution for the high group. A 
biserial coefficient was computed in the 
same manner for the Crew Coordination 
key. In both cases the biserial correla- 
tions obtained in this way were con- | 
siderably higher than the corresponding 
triserials, indicating that the two scales 
differentiated the high group from the 
other two, rather than providing a uni- 
form differentiation among the three 
criterion levels. 
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INTERPERSONAL RELATIONS IN THREE-MAN 


INTERPRETATION AND DISCUSSION OF 
HOMOGENEOUS SCALES 


Technical Competence Key 


Composition and definition, Five of the six 
scores composing the Technical Competence key 
shown in Table 5 represent ratings of the Ob- 
server by other members of the crew or by him- 
self on certain of the items, as indicated. Three 
of the five scores represent total crew ratings of 
the Observer by all three crew members. The 
remaining two were ratings of the Observer by 
the Aircraft Commander, These ratings of the 
observer refer to aspects of his performance such 
as the frequency of errors, competence in per- 
forming the technical specialty, interest in per- 
forming the specialty, and consistency in per- 
forming the crew role, The crew's ratings of 
satisfaction with over-all crew performance (18 
total) constitute the sixth valid item in the 
key. 

Validity and interpretation, The key has a 
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positive, linear relationship of +.43 with the 
criterion, with individual items ranging in sig- 
nificance from .10 to .20. The findings suggest 
that the greater the competence of the Observer 
in carrying out his assigned function, the more 
effective the crew, as ranked on the criterion. 
The finding that items that evaluate the compe- 
tence of the Observer are valid is understand- 
able, since a large portion of the criterion vari- 
ance is considered to be due to the Observer's 
performance. 


Leadership Key 


Composition and definition. Five of the six 
scores that compose the Leadership key, shown in 
Table 6, are ratings of the aircraft commander. 
The sixth is a rating of the copilot. Items are 
ratings of the aircraft commander’s ability to 
put crew members at ease, to make being a 
member of the crew enjoyable, and readiness to 
take initiative. The final item includes ratings 
of both the aircraft commander and copilot for 
the degree of acceptance or rejection of responsi- 


TABLE 5 
TECHNICAL COMPETENCE KEY 


Item Description 


Significance 
Level of 
Validity 
ased on x*) 


Con- 
tingency 
Coefficient (b 


Interrater 
Agreement 
(Horst) 


Loading 


Rank the members of your crew for 
the frequency with which they make 
errors in the performance of crew ac- 
tivities in the air. 


40 
(Total) 


Rank the members of your crew for 
their competence, in air activities, in 
the specialty to which they are as- 
signed. 


140 
(Total) 


21 AC of O 


Rank the members of your crew in 
(Total) 


terms of the extent to which they are 
interested in their technical specialty 
in both air and ground activity. 


Rank the members of your crew for 
their satisfaction with the crew's 
over-all performance in both air and 
ground activities. 


(See 4 above). 


18 
(Total) 


4AC of O 


Rank the members of your crew for 
the extent to which they are consist- 
ent (level of performance same from 
day to day) in their performance of 
activities in the air. 


220 
(Total) 


.48 -45 .20 


_* Dashes in the Agreement Index column indicate that it was inappropriate to compute this value 
since only one rating is involved in the score. Dashes in the Validity Level column indicate that the 


score was not valid at the .20 level of significance. 


Item and 
Rating 
Used 
-61 -50 +50 .20 
-55 -44 -20 
-50 .81 -50 .20 
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TABLE 6 


LEADERSHIP KEY 


Item and Interrater Con- om 
Rating Item Description Loading Agreement  tingency Validit 
Used (Horst) Coefficient ed 
1 AC Rank the members of your crew for 
(Total) the extent to which they accept or 
reject responsibility in both air and 
ground activities. Ie 
24 AC Rank the two other members of your 
(Total) crew in terms of your liking for them 
in both air and ground relationships. -59 55 . .02 
11 AC Rank the members of your crew for 
(Total) the extent to which they put your 
crew at ease and make being a mem- 
ber of the crew more enjoyable in 
both air and ground activities. .46 .20 


24 Pof AC (See 24 AC above) 
Rank the members of your crew in 
terms of the extent they take the ini- 
tiative in getting things done in both 
air and ground activities. 


(See 1 AC above) 


3 AC 
(Total) 


1Oof P 


-56 


-52 51 -10 


-48 -05 


bility. The key seems to contain important as- 
pects of the leadership function. 

Validity and interpretation. All scores in- 
cluded in the present composition of the key 
have a significant relationship with the criterion. 
The key had a negative relationship with the 
criterion, and a triserial validity coefficient of 
—.45 Was obtained for the total score. The mean 
for the high group was well differentiated from 
the means of the other two groups, and a 
biserial correlation of the high group versus a 
combination of the other two yielded a coeffi- 
cient of —.55. 

The negative relationship can be interpreted 
in several different ways. For the most effective 
crews, functional leadership may be based in the 
group as a whole rather than being exercised 
by the Aircraft Commander. Under these cir- 
cumstances the Aircraft Commander would be 
less frequently required to put the crew at ease, 
to take initiative, or to accept responsibility. 
An alternative explanation of the negative cor- 
relation or inversion in mean ratings is that the 
members of the least effective crews felt 
threatened by a psychological test of the kind 
from which these data were drawn, They would 
feel compelled to depict their aircraft com- 
manders as unusually competent. The least effec- 
tive crews then might be less secure in admitting 
their own inadequacies so that they create a 


“halo” of effectiveness for their aircraft com- 
mander by giving him more extreme ratings. 
The effect on ratings would be the same in 
either case. Perhaps both these types of causation 
occur. 

A third possible interpretation is that those 
crews are most effective in which the aircraft 
commander does not put crew members at ease, 
does not try to make being a member of the 
crew more enjoyable, and does not readily ac- 
cept responsibility. A similar finding has been 
reported by Halpin (2). He found that B-29 
crews’ ratings of the “consideration” of their 
aircraft commanders were negatively related to 
the effectiveness of these aircraft commanders in 
combat as rated by their superiors. He referred 
to this as “the dilemma of leadership,” since 
the more the commander pleases his crew the 
lower he is rated in effectiveness by his superiors. 
In the case of the Crew Interaction Scale Lead- 
ership key, the crews that rated their aircraft 
commanders highest for making crew member- 
ship more enjoyable, accepting responsibility, 
etc., were least effective in terms of the per- 
formance criterion. 


Crew Coordination Key 


Composition and definition. The Crew Coor- 
dination key shown in Table 7 consists of ratings 
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TABLE 7 
Crew CoorDINATION KEY 


Item Description 


Significance 
Level of 
Validity 

(based on x?) 


Con- 
tingency 
Coefficient 


Interrater 
Loading Agreement 
(Horst) 


Rank the members of your crew for 
the extent to which their actions are 
well-timed and appropriate to the ac- 
tions of the other members of the 
crew in air activities. 


Rank your crew for its ‘cockpit con- 
fusion.” 


(See 8 P of AC above). 
(See 8 P of AC above). 


(Total) 
8 Ps 
8 AC 
Rank your crew for the extent to 
which it sticks together in the face of 


disrupting factors in both air and 
ground activities. 


80 
(Total) 


of the extent to which the aircraft commander's 
and copilot’s actions were well-timed and appro- 
priate. Ratings by the observer of the crew's 
“cockpit confusion,” and of the extent to which 
the crew sticks together in the face of disrupting 
factors, are included in the key. The common 
element among these items seems to be coordina- 
tion within the crew. 

Validity and interpretation. This key has an 
apparent curvilinear relationship with the cri- 
terion, the most effective crews having given 
themselves the highest, the least effective crews 
the next lower, and the middle crews the low- 
est mean ratings. A relationship with the tri- 
chotomized criterion of —.23 and a biseria] cor- 
relation of —.48 were obtained. 

The keyed items have validities that are sig- 
nificant at or beyond the 10-per-cent level, with 
curvilinearity apparent in the relationships of 
individual scores to the criterion. The curvilinear 
relationship might be explained by assuming 
that the most effective crews did not rate them- 
selves highly coordinated because of their type 
of work organization, as discussed in connec- 
tion with the Leadership key; whereas the least 
effective crews did not rate themselves highly 
because their coordination was inferior to that of 
the middle criterion group. On the other hand, 
since the means of the two lower groups are 
close together, the curvilinearity may be fortuit- 
ous, with the true relationship being one in 
which the upper criterion group is differenti- 
ated from the other two. 


Morale Key 


Composition and definition. All items in the 

Morale key shown in Table 8 are based on the 
combined ratings of the entire crew. Five items 
are crew-level items, while two others represent 
the sum of the individual ratings by the entire 
crew. 
The items seem to fall into two subgroups. 
Ratings such as morale of crew, feeling frus- 
trated, and enthusiasm for flying in crew assign- 
ments seem to be directly related to morale. 
Items such as maintaining a consistent level of 
efficiency, giving directions with clarity, and being 
a well organized team seem to be related to 
crew integration and to technical competence. 
Although items seem to refer to several aspects 
of crew organization, the common content of 
the items is designated as Morale. 

Validity and interpretation. The total score 
for the key has a bimodal distribution and a 
curvilinear relationship with the performance 
criterion. None of the items has a significant 
degree of validity. 


Cooperation Key 


Composition and definition. The Cooperation 
key, shown in Table g, refers to the extent to 
which members work as a cooperative unit, are 
ready to accept and adopt crew decisions, and 
feel affected because other crew members have 
not provided them necessary information or 
instruction. Three of the five scores, including 
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Item and 
Rating 
Used 
+59 -64 +05 
-56 -57 -10 
-48 -65 .05 
-48 -II -57 -10 
-55 
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TABLE 8 
MorALE 


Item and Interrater Con- Soto 
Rating Item Description Loading Agreement  tingency Validity 
Used (Horst) Coefficient y 


(based on x?) 


35 Rank your crew for the extent to 
(Total) which it is a well organized team in 
both air and ground activities. .70 .48 


37 Rate of morale of your crew in both 
(Total) air and ground activities. 


12 Rank the members of your crew for 
(Total) the extent to which they feel frus- 
trated by being a member of this crew. .69 -79 —- — 


41 Rank your crew for the extent to 
(Total) which it is able to maintain a con- 
sistent level of flying. 63 +33 — 


32 Rank your crew for its enthusiasm for 
(Total) flying in present crew assignments. 


17 Rank the members of your crew for 
(Total) clarity in giving directions both in air 


2 To what extent does your crew work 
(Total) as a well organized team rather than 
as a collection of individuals in both 
air and ground activities. 


TABLE 
CooPERATION KEY 


Item and Interrater Con- 
Rating Item Description Loading Agreement  tingency Validit 
Used (Horst) Coefficient y 


(based on x?) 


5 Rank the members of your crew for 
(Total) the extent to which they work co- 
operatively with the crew in both air 


2 Rank the members of your crew in 
(Total) terms of being agreeable and willing 
to go along with crew decisions in 

both air and ground activities. .67 .69 — — 


27 Rank the other two crew members in 
(Total) terms of how often you are handi- 
capped in doing your job because 
they have not given you necessary 
information or instruction in both 
ground and air activities. 


cf (See 5 above). .61 .38 .50 .20 
ota 


5 AC (See 5 above). 
(Total) -61 
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the ratings of the crew, the aircraft commander, 
and the observer, are based on the cooperation 
item. 

Validity and interpretation. The key has linear 
and negative relationship with the criterion. 
The correlation is —.24, and only three items 
have a validity relationship within the .2o level 
of significance. To the extent that a significant 
trend is established in these data, the more 
efficient crews rate themselves lowest on coop- 
eration, agreeableness, and feeling handicapped 
through lack of communication. As has been 
indicated on other keys, the negative validities 
may indicate the high-performance crews are 
not so centrally organized as the low-perform- 
ance crews, Alternatively, they may be less 
defensive in completing a questionnaire and, 
consequently, feel less compelled to rate them- 
selves highly. In any case this key has a moder- 
ate, negative relationship with the criterion. 


Crew Unity Key 


Composition and definition. The items in the 
Crew Unity key, shown in Table 10, refer to 
effectiveness in crew planning, the extent to 
which members back up one another, the desire 
to do a good job, and the feeling of being left 
out of important crew decisions. The common 
element is identified as crew unity. 

Validity and interpretation. Because of its 
high intercorrelations with several of the keys 
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(e.g., +.96 with the Morale key) and because 
it contained four items, only one of which is 
valid at the .20 level, this key was not considered 
sufficiently independent to merit separate valida- 
tion or other analysis. 


FURTHER ANALYSIS 


Second-Order Analysis of Scale Inter- 
correlations 


To determine the manner in which the 
five homogeneous scales were grouped at 
the second-order level of éomplexity, the 
scale intercorrelations were subjected to 
factor analysis. wo centroid factors were 
extracted from the correlation matrix 
(Table 2). The centroid and rotated 
loadings for the two relatively indepen- 
dent second-order factors derived are 
presented in Table 11. Examination of 
the rotated loadings indicates that Crew 
Coordination and Leadership keys are 
relatively pure measures of one of the 
second-order factors. Technical Compe- 
tence is a relatively pure measure of the 
other second-order factor. The Morale 


TABLE 10 


Crew Unity Key 


Item Description 


Significance 
Level of 
Validity 

(based on x?) 


Con- 
tingency 
Coefficient 


Interrater 
Agreement 
(Horst) 


Loading 


Rank the other two members of your 
crew for the readiness with which you 
would expect them to back you up if 
a misunderstanding arose in your 
crew in ground activities. 


(Total) 


Rank the members of your crew in 
terms of the extent to which they 
want to doa good job in both air and 
ground activities. 


15 
(Total) 


To what extent do you feel “‘left out”’ 
of important decisions that your crew 
makes in both air and ground activi- 
ties? 


29 
(Total) 


Rank your crew for its effectiveness 
in planning together in both air and 
ground activities. 


40 
(Total) 


ating 
Used 
260 
.68 -39 -49 
-62 — .06 
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TABLE 
SECOND-ORDER Factor LOADINGS OF THE FIVE KEYS 


Key 


Centroid 
I I 


Rotated 
I II 


1. Technical Competence 
2. Leadership -77 
3. Crew Coordination 
4. Morale -92 
5. Cooperation .83 


| .04 75 

«79 .O1 -59 

.65 .68 .89 

-40 .69 


and Cooperation keys have loadings on 
both of the second-order dimensions and 
seem to be complex at this level. While 
five homogeneous keys can be identified 
through item-scaling, results from the 
second-order analysis support the con- 
clusion that there are two underlying 
factors operating to determine item re- 
sponses. They deal primarily with judg- 
ments of the interpersonal working rela- 
tions (Crew Coordination and Leader- 
ship keys) and with judgments of the 
technical competence of the Observer 
(Technical Competence key). A graphic 
representation of the relationships is 
shown in Fig. 1. 


TECHNICAL 
COMPETENCE 
MORALE 
COOPERATION 
LEADERSHIP 
CREW 
COORDINATION 
° 5 10 


Fic. 1. Rotated positions of the five homogeneous 
keys on the two second-order factors. 


Reliability and Validity of the Combined 
Scores 


Since the relationships of some of the 
keys (Leadership, Crew Coordination, 
and Technical Competence) to the cri- 
terion, as well as to one another, are 
not linear, a combined score was obtained 
by an unweighted combination of scale 
scores, rather than by obtaining weights 
through multiple correlational analysis. 
The composite score, obtained by sub- 
tracting Crew Coordination and Leader- 
ship from the Technical Competence 
(Score = TC — CC — L), yielded a triser- 
ial validity coefficient of +.62, as shown 
in Table 12. 

Since the high criterion group is dis- 
criminated from the other two better 
than they are from one another, a biserial 
correlation was also computed and 
yielded a validity coefficient of + .76. 
The corrected odd-even reliability of the 
Composite score was +.80. 

Cooperation had loadings on both second-order 
factors, with the higher of its two loadings on 
the first factor. It also had a moderately nega- 
tive validity coefficient. In order to determine 
whether the inclusion of the Cooperation key 
with its moderate validity would add to the 
validity of the composite, a second combination 
of keys was obtained by subtracting the Coopera- 
tion score from the composite score mentioned 
above Score—TC—CC—L—OC). It 
was anticipated that adding this key to the 
composite score would lower the validity of the 


composite, since the Cooperation key had load- 
ings on factors with opposite relationships to 


Loadings | 

| 

—.61 

-41 

.33 

.06 
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ae the criterion. The triserial validity coefficient 
so for the combination of four keys was +.56, and 
the corresponding biserial coefficient, +.64. The 
corrected odd-even reliability coefficient for the 
combined scores from the four keys was +.92. 


Based on the various combinations of 
scales to form a composite score, the 
maximum validity coefficient was given 
by the subtraction, without weighting, of 
the Crew Coordination and Leadership 
scores from the Technical Competence 
score. 


Dichotomized Criterion Groups 


SUMMARY AND CONCLUSIONS 


The purpose of the study was to de- 
velop an improved measure of inter- 
personal relations among aircrew mem- 
bers. Based on the literature and the 
results from laboratory experiments de- 
signed to answer certain methodological 
questions, forms of the Crew Interaction 
Scale were constructed and administered 
to U. S. Air Force B-47 crews on two 
separate occasions. The initial admini- 
stration, which included intensive inter- 
views of B-47 crews to determine the 
suitability of items, served as the basis 
for the revised form. The final revised 
scale was administered to thirty B-47 
crews of three members each and pro- 
vided the data for the statistical analysis. 


Validity 


< 


Trichotomized Criterion Groups 


RELIABILITY AND VALIDITY OF THE COMPOSITE SCORES 


Agreement in Rating Items 


The results of the interrater reliability 
analysis indicated that there is agree- 
ment among the ratings given to a crew 
as a whole and to its members individu- 
ally, and that there is satisfactory dis- 
crimination in the average ratings for 
the different crews. The highest internal 
agreement was obtained for the first 22 
items, for which nine individual judg- 
ments per item were made, The next 
highest internal agreement was found for 
items 23 through 27, that included six 
individual judgments per item. The least 


M 


Corrected 


Odd-Even 
Reliability 


Composite 
Score 
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internal agreement was found for items 
28 through 44, in which only three indi- 
vidual judgments were represented. 


Item Validity 


Based on a composite performance cri- 
terion composed from rankings of crews 
by the Wing Standardization Board and 
squadron commanders, item validities 
were computed to provide information 
concerning aspects of crew relations 
significant for the performance criterion. 
Approximately g5 scores with significance 
levels at or below .g0 for the trichoto- 
mized criterion were identified. 


Homogeneous Scale Development 


Scales derived from the interrelation- 
ships of the ratings lead to the identifi- 
cation of five dimensions of crew rela- 
tions which were identified by the titles 
Technical Competence, Leadership, Mo- 
rale, Crew Coordination, and Coopera- 
tion. The scales representing these di- 
mensions have satisfactory reliability as 
determined by the odd-even method and 
three of them show significant validity. 
One of the three validly predictive scales 
(Technical Competence) has a positive 
relationship to the criterion, The rela- 
tionship of the other two validly predic- 
tive scales (Leadership and Crew Coor- 
dination) with the criterion is negative. 


Second-Order Analysis of Scale Inter- 
correlations 


To determine the manner in which 
the five homogeneous scales were grouped 
at the second-order level of complexity 
the scale intercorrelations were subjected 
to factor analysis. Two centroid factors 
were extracted from the scale intercor- 
relations. The analysis of the interrela- 
tionships indicated that there are two 
underlying factors on which ratings are 
based. One can be identified with the 


Technical Competence key, which has 
a positive, linear, and valid relationship 
to the criterion. Except for further re- 
finement, it seems to be satisfactory in 
its present form. The significant ratings 
on this scale were for the crew member 
called the Observer. 

The other basic dimension concerns 
crew relationships. The Leadership and 
Crew Coordination keys have high load- 
ings on it. For the Leadership key the 
high criterion group was differentiated 
sharply from the two lower groups. On 
the Crew Coordination key the tendency 
toward curvilinearity was even more 
marked, with the mean for the middle 
group being somewhat lower (represent- 
ing more integration) than either ex- 
treme group. 


Composite Scores 


The composite scores obtained from 
the homogeneous keys of the Crew In- 
teraction Scale take into account the 
opposite relationships of the basic di- 
mensions with the criterion. A validity 
coefhcient of .62 (triserial correlation) 
and .76 (biserial correlation) is obtained 
from the subtraction (without weighting) 
of Leadership and Crew Coordination 
from Technical Competence. 

One other key, Cooperation, was con- 
sidered for inclusion in a composite 
score since it had moderate negative 
validity. However, the Cooperation key 
had appreciable loading on both second- 
order factors, which have opposite rela- 
tionships to the criterion. Combining it 
with the other scores raised the reliability 
but lowered the validity of the compos- 
ite. 


Conclusion 


Within the framework of the present 
study the research has demonstrated that 
the direct assessment by crew members 


| 
| 


INTERPERSONAL RELATIONS IN THREE-MAN 


of one another constitutes an effective 
means for investigating and measuring 


interpersonal relations in three-man 


crews, and provides a means for predict- 
ing the efficiency of crews that have al- 
ready been organized. 

An additional significant finding is that 
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three keys, Leadership, Crew Coordina- 
tion and Cooperation, were related nega- 
tively with the criterion. Possible inter- 
pretations for these unexpected results 
were presented in connection with the 
discussion of each of the keys as given 
in the text. 
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